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Abstract 

Introduction. The challenges of placing virtual objects in a real-world environment limit the potential of augmented 
reality (AR) technology. This situation identifies a gap in scientific knowledge that requires additional research. 
Therefore, the main task of this study was to develop a method for optimal placement of virtual objects, in which the 
objective function of comfort was minimized. This approach is aimed at improving AR systems and developing the 
corresponding theory. 

Materials and Methods. The conducted research was based on the analysis of the placement of virtual objects in AR/VR 
applications with particular emphasis on optimization. The concept of comfort of placement was proposed, taking into 
account the size of the object and the distance to the boundaries of free space in X, Y, Z coordinates. 

Results. As part of the study, formulas were obtained for the optimal placement of objects with an arbitrary comfort 
function. The basic criterion was to minimize the difference between comfort levels from different sides of the object. It 
was found that a successful placement of objects required taking into account their size and comfort zones, as well as 
solving a system of n linear equations. 

Discussion and Conclusion. The results obtained make an important contribution to the study of the problem of placing 
virtual objects in AR/VR/MR. They open up new opportunities for improving user interaction and conducting further 
research in the field of spatial computing. Possible directions for further development are dynamic adjustments and 
integration of the results into various XR scenarios. 
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AHHOTauHA 

Beedenue. \[poOnempl, cBa3aHHble Cc pa3MelleHHeM BHpTyaIbHbIX OOBEKTOB B PpeasIbHOM cpeye, CyLeCTBeHHO 
OrpaHH4HBalOT BO3MOXKHOCTH TeXHOJOrHH AOMONHeEHHOM peambHocTH (AR). Takaa cuTyallua BbIABJIAeT TIpOOeN B 
Hay4HBIX 3HaHUAX, TpeOyIOMMi JONOJHUTeIbHOrO UcceqoBaHHA. IlosToMy OCHOBHOH 3ayauel JaHHoro HcceqoBaHUA 
ABHIACbh pa3paOOTKa MeTOa OMNTHMaJIbHOrO pa3MeCHHA BUPTyaIbHbIX OOBCKTOB, Tp KOTOPOM MpPOHCcxXOAHT 
MHHUMH3alHA WeseBon PyHKUMH KOM@opTHocTH. Tako WoAxXoy HalpaBleH Ha yCOBepuIeHCTBOBaHHe cuctem AR u 
pa3BHTHe COOTBeETCTBYIOMeH TeOpuHu. 

Mamepuaaoi u memooui. Uipopeyennoe uccreqoBaHve OCHOBbIBaCTCA Ha aHaJIN3e Pa3sMeLLCHHA BUPTYAIbHbIX OOCKTOB B 
AR/VR mpysioxKeHHAx C OCOOBIM aKICHTOM Ha ONTHMH3alHI0. bpi0 mpes10oxKeHO MOHATHE KOM@OPTHOCTH pa3MelleHHA, 
YUUTbIBAaIOLee pasMepbI OObEKTa H paccTOAHHA JO TpaHHL CBOOOAHOrO IpocTpaHcTBa 0 KoopAuHaTam X, Y, Z. 
Pezyismamot ucciedoeanua. B pamkax vccieqoBaHHaA OLIN MoyYeHbI POpMyBI [IA ONTHMAabHOTO pa3MeLleHHA 
OOBEKTOB C IPOM3BOJIbHOM PYHKUMel KOMPoOpTHOCTH. OCHOBHBIM KPHTepHeM ABIIACTCA MMHUMV3AUHA pasHULbl MEK LY 
YPOBHAMM KOM@OPTHOCTH C pa3HBIX CTOPOH OObeKTa. bp0 BbIABIICHO, UTO yCIelWHOe pa3sMeleHHe OOBeEKTOB TpeOyeT 
yueTa HX pa3MepoB H 30H KOMOPTHOCTH, a TakoKe PeLICHHA CHCTEMBI V3 N JIMHeMHBbIX ypaBHeHHH. 

O6écyordenue u 3akmou4enue. TonydeHHble pesyibTaTbI MpelcTaBaioT coOol BaxKHbIM BKIay B HCcueqoBaHHe 
TIpOOJeMBI pa3sMeLleHHA BUPTYAIbHBIX OObeEKTOB B AR/VR/MR. Onn OTKpbIBaIOT HOBbIC BO3MOXKHOCTH JIA yIyYWeHHA 
B3aHMOJIeHCTBUA C TOJb30BaTeIAMH UM MpOBeeCHHA MabHeMUIMX UcceqOBAaHHHM B OONaCTH MpocTpaHcTBeHHbIxX 
BBIYHCICHHM. Bo3MO2KHbIMH HallpaBICHHAMNH JIA WaIbHeMWero pa3sBUTHA ABJIAIOTCA WHHAMMYECKHe KOPpeKTHPOBKH HU 
MHTerpalla MOUYYCHHBIX Pe3YJIbTATOB B pa3sM4HbIe XR-cyenapun. 


KoroueBbie CJ10Ba: AWOHOJIHCHHAA PeasJIbHOCTb, BHUPTYaJIBHbIe OObEKTHI, dbu3sn4eckoe TIPOCTpaHCTBO, pallHOHaJIbBHOe 
pa3MelieHne, MaTeMaTHYeCKadA MOJCJIb, YDAaBHCHHA 
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9KCHeEpTH3y HW WeHHbIe peKOMeHallHH M0 yJIy4WIeHHI0 CTaTbH. 
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Introduction. Rapid development of augmented reality (AR) technology opens up new opportunities in various 
fields — from entertainment to education and industrial applications [1, 2]. However, despite considerable achievements, 
there are numerous problems that need to be solved, specifically, in the context of placing several virtual objects in a real- 
world environment. One of such problems is the optimal placement of virtual objects in augmented reality applications 
to provide for optimal and comfortable user experience [3-5]. 

This problem arose in connection with the need for the device to understand physical space. For effective placement 
of virtual objects in the real world, the application should be able to correctly interpret the material environment in which 
the user is located applying sensors and cameras of mobile devices [6]. 

This article presents a new approach to determining the optimal placement of virtual objects in physical space. This 
problem has some similarities with another close topic of generative contextual scene augmentation (CSA), where the 
key goal is to create a harmonious and convenient interaction between virtual and physical objects [7, 8]. However, the 
approach proposed by the authors differs from the one mentioned, since it focuses on determining the optimal distance 
between objects using a monotone comfort function, while CSA takes into account the semantics of the scene, the context 
and the meaning of virtual objects. 

Existing approaches to solving the problem of rational location of virtual objects are usually limited by assumptions 
about the form of the comfort function, and they do not always guarantee the optimality of the solution. This article 
proposes a new approach that is significantly different from those currently used. This makes it more flexible to find a 
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rational arrangement of virtual objects and provides a universal solution for various scenarios and conditions. The term 
“optimal placement” is used for the following reasons: firstly, the final choice in the proposed recommendations is still 
at the discretion of the user; secondly, despite the fact that in the context of this work, the task of minimizing the objective 
function is solved, it contains elements of fuzzy sets. 

Within the framework of this work, the concept of optimal placement of a set of virtual objects in a one-dimensional 
physical space is introduced. A model has been developed that allows solving the problem of optimal placement of a set 
of objects and results, regardless of the choice of the type of comfort function, in a system of linear equations for 
determining the optimal distances between objects. As an example, the solution to the problem for the case with two 
virtual objects is given. 

The objective of this article is to propose and demonstrate a new approach to determining the optimal placement of 
virtual objects in physical space, to establish its applicability and efficiency. Mathematical formulations and methods for 
solving the optimal placement problem are presented, as well as examples of practical application of the results obtained. 
This will show new opportunities for improving the interaction between virtual and physical objects, as well as contribute 
to the development of the theory and practice of augmented reality. 

Thus, this article is aimed at deepening the understanding of the problem of optimal placement of virtual objects in 
physical space and offering a new approach to its solution. The results of the study can be used to create more efficient 
and user-friendly virtual reality systems, as well as for further development of theory in this area. 

Materials and Methods. Placing virtual objects in a real physical space is a task that arises in almost every AR/VR 
application. For all its simplicity, it can create challenges in case of insufficient attention to the issue of optimizing the 
placement of such objects, up to the complete refusal of a large number of potential users to work with the mentioned 
applications. The optimization problem is most acute when it is required to place several virtual objects at once in a given 
physical space. At the same time, even in the case of placing only one object, only recently the concept of “comfort” of 
its placement was formulated and a corresponding model was proposed [9], consisting of the following. 

An object embedded in a three-dimensional physical area is presented as a rectangular parallelepiped with 
characteristic dimensions: / — length; d — width; h— height. At the same time, for each of X, Z, Y coordinates, the 
following concept of placement comfort is introduced. It is clear that the size of the free space should not be less than the 
size of the object, but, in addition, for each coordinate, the concept of comfortable distances from the object to the 
boundary of free space is introduced. For example, for X coordinate, we introduce the concept of comfortable distance on 
the left — D_ and right — D, and, respectively, left and right comfort —— K_ and K, . Denote the distances to the left 


and right of the object to the boundary of free space X_ and X,. We assume that K_ =1,if X_2D_ and decreases to 


0 when approaching zero. For example, for simplicity, let us take linear dependences K_ (Xx a) D_) and K, (xX, / D,) : 


xX 
—, xX <D, 

K_=3D_ . (1) 
1,X >D. 


Dependence K, (xX, / D,) is similar (1). In exactly the same way, we introduce the concept of comfort on one side 


and on the other for Z and Y coordinates. 
If the size of the free space horizontally is L 2 D_+/+D, , then the problem of comfortable placement (K_ = K, =1) 


does not arise; and all problems appear when /<L<D_+/+D,. In this case, the concept of comfort of the object 


placement is introduced, when comfort on the one hand is not obtained at the expense of comfort on the other hand. We 
introduce the target function of comfort: 


K, =(K_-K,) . (2) 
By optimal placement, we will understand such placement, in which minimum K, is achieved. Obviously, this 
happens if K_=K,. 
As it was shown in [9], if dependences K_ (X 7 / D_) and K, (x im / D,) are linear, the minimum of the target function 
(2) corresponding to the optimal placement of the object is attained at the following values X_ and X,: 
D 


BE i 


Information Technology, Computer Science and Management 


205 


http://vestnik-donstu.ru 


206 


Advanced Engineering Research (Rostov-on-Don). 2023;23(2):203—211. eISSN 2687-1653 


X,=L-X_-1=(L Na (3) 


Formulas (3) are simple and convenient for optimal placement of a single virtual object. As noted in [9], their 


disadvantage is that they were derived for the case of linear (1) comfort functions K_ (X_ Fs D.) and K, (xX, / D,) . We 
show that they are always valid if functions K_ (X_ /D_) and K, (X, /D,) are the same function k(x), satisfying the 


condition that it increases monotonically for 0< x <1, and is equal to 1 at x >1. The type of such function 


K_ (X_/D_) = k(x) is shown in Figure 1. 


1.0 


0.5 


Comfort criterion K- 


0.5 1.0 1.5 


Distance normalized to the comfort zoneX- / D- 


j=) 


1-x°,0<x<l 


Fig. 1. Comfort function dependence k(x) = 
l,x>l 


Figures 2 and 3 present additionally two more functions — cubic and linear, demonstrating similar described behavior. 
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Fig. 2. Comfort function dependence k(x) = 
1,x>1 
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Fig. 3. Comfort function dependence k(x) = 
1x>l1 


Indeed, suppose we need to embed an object of size / with comfortable distances on the left D_ and right D, into the 
space bounded by size L, and conditions /< L< D_+/+D, are met. Then, if one-sided comforts are presentable in the 
form K_(X_/D_)=k(x_), K,(X,/D,)=k(x,), where x_=X_/D_, x, =X,/D, , and dependence k(x) satisfies the 
above conditions, then, from the minimum condition of the objective function (2) we obtain: 

K_=K,=>k(X_/D_)=k(X,/D,). 

For the given nonlinear comfort function k(x), the resulting equation can be solved numerically by one of the known 

methods. However, since one-sided comforts are described by self-similar function k(x), from equation 


k(X_ / D_) = k(X, / D,) , we obtain relation X_/D =X,/D,, from which, taking into account equality 
L=xX_+1+X, , equations follow (3). 


Thus, it is shown that simple and rather convenient equalities (3), which provide embedding an object with optimal 
comfort, are valid for any one-sided comfort function k(x). 

Research Results. In a real situation, there is a need to place several objects at once. In this case, it makes no sense 
to solve sequentially the problems of optimal placement of the first object, then the second, third, etc., since when placing 
the next object, a need arises to shift previously installed objects so that the placement is optimal for the totality of all 


objects. If condition L< 310 is met, the objects in principle do not fit in the free space of length L. If 


i=l 


Le s ( DO +10 + D” ) then the objects can be placed so that they do not interfere with each other. In reality, the problem 
i=l 


of optimal placement arises if the following conditions are met: 


YIM <L< (oP +1 4p ). (4) 
i=l i=l 
In this case, we introduce the target function: 
1 2 n 
K,=KO+K4+..4K™, (5) 


where KY — comfort of the i-th object determined by formula (2). Here, when there are two consecutive objects with 
numbers 7 and i+1, then their neighborhood will be comfortable if the distance between them is not less than Dp! + Dl'*!) 


, which corresponds to the new comfortable distances dD = Dl) =D” + D('*) , i=1,2,...,(n-1) since a comfortable 


distance to the wall is one thing, and to another object, from where something can be pushed, is quite another. The rational 


arrangement of embedded objects is determined by the minimum of the target function (5). 
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The minimum of the target function (5), taking into account (2), gives us a system of n equations: 


K® =0; K® =0; ..., K& =0. (6) 
From (6), it follows: 


K =K; §=1,2,3,..50. . 


The system of equations (7) can be written in the following form: 


x x?) 
‘om “air 
(i) (i+1) 
ee eg |, eG, 
dD” B® 


(x) Ree ® 
| ae | — 2 I, 


That is, we have obtained n equations with respect ton unknowns X(), X),...,.X(") , where X(!) — distance of the first 
object from the left edge of the embedding area, X('), i = 2,3,...,2 — distance between objects with numbers i and (i-1). 


Since function k(x) is monotonic, system (8) is reduced to a linear system of equations, which does not depend on the 


type of the comfort function itself k(x). 


x9 x 
Uae aan, 
BO BO” 


Sees i=l 
(n) dD” . (9) 


- + 


System (9) can be solved by one of the known methods. However, due to the fact that the matrix of system (9) is 
highly sparse, the solution to the system can be found quite simply. For example, in the first (n-1) equations, it is possible 
to express X('#) by X( in each i-th equation, then, substituting this into the last equation, to obtain a linear equation 


with respect to X(). After that, moving from the first equation to (n-1)-th, we can consistently find X), X@),...,X™. 


In the case of placing two virtual objects, n=2, system (9) takes the following form: 


au x?) 
DO Be 
x9 pexO_x@ _79 _]72) 
52) A") (10) 
From system (10), we find: 
(z —1) = 1°) Bp” 
x) = eee 
"(B+ Dd?) + DBM 
11 
(L-19 1°) BS 1) ot 
x) = + 


(B° + 0°)" +d” bo 


where X w — distance between the first object and the left edge of space; X @) — distance between the right edge of the 


first object and the left edge of the second object. 
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Consider example (12) when: 


L=100, 1 =40, 1° =30, D® =10,D" =5,D° =11,D" =13. (12) 
Since conditions (13) are met, then: 
19) 419) <£<19 4194 DO +d) 4D? + po (13) 


For optimal arrangement of two objects, we can use expressions (11), which give regardless of the form k(x) in this 


case X") = 7.692; XO x 12.308; KY) = K?) =0. Here, the value of one-sided comfort depends on the type k(x). For 


linear dependence k(x), shown in Figure 3, K® =x" = K”) aK” ~ 0.769. If dependence k(x) corresponds to 


Figure |, we get the comfort value Kk” = KH = K”) = KO ~ 0.973 . Thus, the paper introduces the concept of optimal 


placement of a set of virtual objects in physical space. A model has been developed that provides solving the problem 
of optimal placement of a set of objects. It is shown that the solution to this problem does not depend on the type of 
monotone comfort function. 

Discussion and Conclusion. The theoretical aspect of the important issue of optimal placement of a set of virtual 
objects in physical space (the problem often encountered in augmented reality applications) was considered. By 
proposing a new mathematical model and including fuzzy logic, we laid the foundation for an algorithm that could 
potentially help users find a rational and convenient location of virtual objects in their real environment. 

The foundations laid in this study show that the proposed model effectively solves the problems associated with 
the placement of a set of virtual objects in a given physical space. By analyzing virtual planes and taking into 
account the distances between virtual objects and the edges of these virtual planes, our method provides optimal 
placement considering the linear dimensions of virtual objects and the comfort zone around them. 

The results obtained contribute to the current development of augmented and mixed reality applications, 
providing a theoretical solution to the problem of optimal placement, which, in turn, can improve user interaction 
and overall satisfaction with the tools of the technology under discussion. Moreover, the possible applications of 
this research go beyond AR applications, they open up new avenues for research in the related fields, such as virtual 
reality, mixed reality, and spatial computing. 

Considering the results of this study, future developments may be aimed at verifying the algorithm through 
empirical testing, enabling dynamic real-time adjustments based on user behavior, and exploring the integration of 
our approach into various XR application scenarios. As the area of augmented reality continues to evolve, we expect 
that our research will make a significant contribution to the development of the technology, inspiring its wide 


dissemination and further enriching the user experience. 
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